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Description 

DYNAMIC OBJECT AVOIDANCE WITH 
AUTOMATED GUIDED VEHICLE 

Cross Reference To Related Applications 

[0001] The present application claims the benefit of U.S. provi- 
sional application Serial No. 60/481,113, filed July 21, 
2003, for DYNAMIC OBJECT AVOIDANCE WITH AUTO- 
MATED GUIDED VEHICLE, which is hereby incorporated 

herein by reference in its entity. 
Background of Invention 

[0002] The present invention relates to an automated-guided ve- 
hicle (AGV) control and, in particular, to a method and ap- 
paratus for dynamically detecting objects in the path of 
travel of the vehicle and guiding the vehicle around the 
object, known as an "obstacle." 

[0003] AGV systems are used extensively today in a wide variety 
of material handling applications. AGVs come in a wide 
variety of types from those carrying cargo on their back to 
those that tow trains of cargo behind them on carts, to 



still other types. In order for each AGV to be able to auto- 
matically guide itself throughout a factory or plant, it 
must be able to determine its position within the factory 
and the orientation of the vehicle. A common system uti- 
lizes dead-reckoning navigation. An example includes in- 
cremental sensors used on the AGV including wheel en- 
coders that measure the rotation of one or more wheels 
on the AGV and gyroscopes that measure change of the 
vehicle's orientation. Update markers, such as magnets 
buried in the floor, transponders positioned as known lo- 
cations, and the like, correct for drift in the dead- 
reckoning navigation. The vehicle is controlled along a 
virtual guide path, namely, a guide path which is defined 
in a computer memory, either on the vehicle itself or at 
some central control. This is in contrast to a physical 
guide path, such as wires or active strips in the floor. 
[0004] Once a virtual guide path is established, it has required 
programming changes in order to change the guide path. 
In United States patent application Ser. No. 10/394,546 
filed March 21, 2003, by Werner et al. for a GRAPHICAL 
SYSTEM CONFIGURATION PROGRAM FOR MATERIAL HAN- 
DLING, the layout of a virtual guide path is greatly facili- 
tated. However, changes to the guide path still require 



operation of a computer both to change the guide path 

and to restore it to its initial condition. 
Summary of Invention 



[0005] The present invention allows a virtual guide path to be 

momentarily modified in order to direct a vehicle around a 
particular area. This may be accomplished by positioning 
a temporary obstacle, such as a traffic cone, or the like, at 
the beginning of the area with respect to the travel of the 
vehicle. The system will automatically and dynamically 
guide the vehicle around the obstacle and return the vehi- 
cle to the guide path when the obstacle has been cleared. 
This may be accomplished with various types of vehicles 
including vehicles which tow a chain of carts in a train. 
This may be accomplished by producing an offset to the 
virtual guide path at the location of the obstacle automat- 
ically and dynamically in order to guide the vehicle 

through the open area adjacent the obstacle. 
Brief Description of Drawings 

[0006] Fig. 1 is a top plan view of an automated-guided vehicle 
system, according to the invention, illustrating a vehicle 
diverting around an obstruction identified as an "obstruc- 
tion zone"; 



[0007] pjg 2 is a flow diagram of a control system for the auto- 
mated guided vehicle in Fig. 1; 

[0008] Fig. 3 is a block diagram of the control system of the ve- 
hicle in Fig. 1; 

[0009] Fig. 4 is an illustration of a vehicle guiding around a sim- 
ple obstruction; 

[0010] Fig. 5 is a diagram illustrating an AGV guiding around a 
complex obstruction; 

[0011] Fig. 6 is a diagram illustrating parameters used in deter- 
mining guide path offset, or deviation; and 

[0012] Fig. 7 is a diagram of update markers useful with the in- 
vention. 

Description of the Preferred Embodiment 

[0013] Referring now to the drawings and the illustrative embod- 
iments depicted therein, an automated-guided vehicle 
system and method 10 includes one or more guided vehi- 
cles 12 which is controlled, at least in part, by a central 
dispatcher (not shown) which issues commands to the ve- 
hicle 12 as to its destination. In the illustrative embodi- 
ment, the vehicle autonomously travels along a guide path 
14, which is a virtual guide path. The virtual guide path is 
defined in memory, such as in a computer on-board vehi- 
cle 12. It should be understood that the invention may be 



applied to other types of systems, such as systems in 
which a central control provides detailed steering instruc- 
tions to vehicle 12. Vehicle 12 includes a navigation com- 
puter NC which provides dead-reckoning guidance to the 
vehicle. Such dead-reckoning systems are well known in 
the art and will not be described in more detail herein. 
Suffice it say, such dead-reckoning systems produce drift 
from the guide path. Therefore, they are occasionally up- 
dated by an update system such as a marker system which 
is illustrated in the embodiment as a plurality of stationary 
magnets 16 which are intercepted by and detected by a 
magnetic bar under vehicle 12. Such systems are well 
known in the art and will not be described further herein. 
Although illustrated as a series of magnets in the floor, 
other techniques may be utilized to correct for drift in the 
navigation system. Examples include United States patent 
application Ser. No. 10/209,766 filed July 31, 2000, by 
Zeitler for MATERIAL HANDLING SYSTEMS WITH HIGH FRE- 
QUENCY LOCATION DEVICES, the disclosure of which is 
hereby incorporated herein by reference. It is also known 
to provide vehicle 12 with an object detection system, 
known as a "bumper" in order to stop the vehicle prior to 
colliding with a fixed obstacle. Such known systems in- 



elude a scanning laser which scans in a plane or multiple 
planes ahead of the vehicle and detects an object in time 
for the vehicle to stop before colliding with the object. 
Other schemes are known to avoid collisions between the 
vehicles 12. 

[0014] The present invention includes an auto-avoidance com- 
puter 20. Auto-avoidance computer 20 receives input 
from a detection device, such as a laser scanner. The laser 
scanner may be shared with the bumper collision avoid- 
ance system of the vehicle. However, the auto-avoidance 
computer, instead of stopping the vehicle, causes the ve- 
hicle to navigate around the obstacle and back to the 
guide path. This may be accomplished by generating an 
offset 14' to guide path 14, as illustrated in Figs. 1 and 4. 
This is accomplished by sensing the position of an obsta- 
cle, such as a traffic cone placed in an area of travel of the 
vehicle (obstruction zone) 22, and determining an area 
adjacent the obstruction zone in which the vehicle can 
travel. An offset to the guide path 14 is calculated and is 
designated offset 14'. When the vehicle no longer detects 
the cone, the auto-avoidance computer informs the navi- 
gation computer of this occurrence. The navigation com- 
puter can determine an appropriate time to return to the 



original guide patli 14, talcing into account factors such as 
the length of the vehicle. The length of the vehicle may be 
significant when the vehicle is a tugger vehicle that is tug- 
ging a train of carts, or the like. When the vehicle is being 
controlled along an offset guide path 14', it may still be 
necessary to obtain updates to the position of the vehicle. 
This may be accomplished by providing a unique magnet 
pattern 25 in which magnets 16 are arranged off of guide 
path 14 as well as on and along guide path 14. By arrang- 
ing magnets 16 along a diagonal, a magnet may be inter- 
cepted even while the vehicle is traveling along offset 
guide path 14'. Moreover, by arranging the magnets along 
a diagonal, the position of each magnet may be uniquely 
determined because it varies in both the X and Y coordi- 
nates from other magnets. Moreover, magnets may be de- 
tected off of the guide path without the necessity for pro- 
viding a grid of magnets as is known in the prior art. 
[0015] In the illustrative embodiment, auto-avoidance computer 
20 is a Sinas algorithm module, which is marketed by 
Siemens Corporation for use in automated-guided vehi- 
cles, such as floor sweepers, and the like. However, in 
contrast to other applications for the Sinas algorithm 
module, the present invention utilizes virtual guide paths 



and offsets from virtual guide paths in order to allow the 
vehicle to deviate from the guide path around an obstruc- 
tion zone and return to the guide path at the end of the 
obstruction. Moreover, the present invention envisions 
that the dynamic object avoidance technique may be uti- 
lized within a limited control area LC, such as a particular 
hallway, or the like. Within the limited control area LC, the 
vehicle dynamically avoids objects as previously de- 
scribed. When outside of the limited control area LC, the 
vehicle stops for obstructions to the guide path as is 
known in the art. 
[0016] The approach is to minimize complexity and impact on 
known systems. This is accomplished by first limiting the 
scope of the automation, using manually entered control 
codes which enable and disable the AA mode and may 
also provide it with configurable limits. Secondly, the im- 
pact of the new functions are isolated by keeping them to 
a small change in the existing NC and using an external 
computer to house the new algorithms. This external 
computer would likely be an embedded PC running 
Timesys Linux with a CAN bus interface to the current NC 
and a serial interface to the laser (either the existing one 
or a second laser specifically for this purpose). Existing 



algorithms should easily integrate into this operating en- 
vironment. 

[0017] The Invention is based upon the fact that the obstruction 
can be determined by occlusion in the plane of a single 
laser sweep. This is not too restrictive for the customer 
and greatly decreases the cost and complexity. 

[0018] An onboard navigation system updates position periodi- 
cally, such as every 10 ms, and can provide position and 
orientation periodically, such as every 50 ms to the known 
algorithms. Guidance calculations may be performed peri- 
odically, such as every 20 ms in most vehicles, but up- 
dates of auto avoidance offset every 50 ms should be ad- 
equate. The navigation solution may be based on dead- 
reckoning, such as using a gyroscope and odometry with 
a Kalman filter providing stabilization and sensor calibra- 
tion through magnet sensor readings. 

[0019] The NC has a path map represented as an arbitrarily 
linked network of lines and arcs with virtual code and 
magnet objects associated with it. It does not however 
have information about walls, equipment or other objects. 
The system can get around this problem by assuming a 
relatively simple 'universal' map for an operational aisle 
with obstructions and manually limit activation to these 



situations. Tlie algoritlims would then assume walls within 
view to the left and right with open floor extending for- 
ward indefinitely. Protrusions or objects on the open floor 
would be candidates for avoidance. Moving objects can be 
filtered out or other objects that should trip a bumper 
stop rather than an avoidance. 
[0020] Functional Requirements 

[0021] Vehicle Management Computer (VMC) 

[0022] Laser Scanner (LS) 

[0023] Navigation Computer (NC) 

[0024] Auto Avoidance Computer (AA) 

[0025] Framework 

[0026] The existing framework of Janz CAN driver and Timesys 
Linux for embedded systems will be utilized. This envi- 
ronment has demonstrated 5kHz discrete I/O data collec- 
tion and is currently being used for high speed IK baud 
CAN data collection at greater than 1000 messages/sec- 
ond rates from photo array sensors. It will provide a 
known platform to easily host the existing Sinas modules 
as well as future migration of NC functionality out of the 
existing 16 bit DOS environment into a more modern and 



capable platform. 

[0027] sinas Algorithm Module 

[0028] This module is to be provided by the Intelligent Au- 
tonomous Systems group of the Information & Communi- 
cations Division of Siemens Corporate Technology. It en- 
capsulates existing Sinas software to handle the laser 
scanner(s) and determine the object avoidance path plan- 
ning. The module will be treated as a black box with the 
following requirements. 

[0029] Software 

[0030] Software provided needs to be compiled for and linked 
into a Linux (or possibly QNX) embedded computer sys- 
tem on the AGV. To assure this and keep the provided 
software as modular as possible it should meet the fol- 
lowing requirements: 

[0031] POSIX/ANSI compliant code 

[0032] Single compilation package 

[0033] Initiated as a single thread with Round Robin Scheduling 
[0034] |\/ianages its own sub-threads 

[0035] Functions 

[0036] Functionality required initially is obstruction detection and 



deviation calculation. Self test and diagnostic functions 
may be provided. 

[0037] Interfaces 

[0038] The Sinas algorithms will be started as a single thread 

with appropriate priority. Root privilege will be present in 
the parent process. The software may start its own sub 
threads as needed. Necessary setup parameters such as 
the serial port identifier for the laser scanner will be pro- 
vided in a argument list at thread startup. The serial port 
connection to the scanner will then be handled by the 
Sinas software. Further communication from the Sinas 
software to/from the NC computer will be routed through 
a pair of semaphore controlled mailboxes. 

[0039] Interface Specifications 

[0040] System Components 

[004 1 ] Vehicle Management Computer (VMC) 

[0042] The VMC handles 

[0043] laser Scanner (LS) 

[0044] This can be an existing Sick scanner in use as a laser 

bumper, or a new scanner specifically for AA use. Option- 
ally, this may be a Siemens laser system. 



[0045] Navigation Computer (NC) 
[0046] Auto Avoidance Computer (AA) 

[0047] This computer will provide the home for the Sinas algo- 
rithms. 

[0048] Sinas Algorithm Module (SAM) 
[0049] Messages 

[0050] Tags are event messages. Dimension lines cover periodic 
message intervals. Those to the top of the drawing are 
NC->AA, while the bottom side are AA->NC. Periodic 
messages are not shown. 

[0051] Events 

[0052] Event messages occur once with a positive acknowledge 
message returned from the receiver. Failure to acknowl- 
edge initiates a retransmit with multiple attempts before a 
failure condition. 

[0053] Activate: NC=>SAM 

[0054] Starts the SAM watching for potential obstructions and es- 
tablishes the baseline path (straight line in plant frame) 
along with limits for deviation. 

[0055] Obstruction Detect: SAM=>NC 

[0056] Based on the activation parameters the SAM will report an 



obstruction detected and estimation of necessary devia- 
tion start point. 

[0057] start Deviation: SAM=>NC 

[0058] Upon reaching tlie required deviation point, tlie SAM will 
note 'Start Deviation' and begin sending deviation updates 
for the NC to follow. 

[0059] Cleared Obstruction: SAM=>NC 

[0060] Once the zero-zero point of the scanner passes the last 
obstruction, a 'Cleared Obstruction' message will be is- 
sued from the SAM to the NC indicating it is ready to re- 
turn to normal path. 

[0061 ] Return to path Deactivate: NC=>SAM 

[0062] Return to path is initiated by the NC when sufficient dis- 
tance past the cleared point has been reached to assure 
train clearance of the obstruction. This clearance is based 
on the assumption that the deviation path is at minimum 
path separation from the obstruction. 

[0063] End Deviation: SAM=>NC 

[0064] Upon sending the final zero deviation update the SAM will 
acknowledge return to path with the 'End Deviation'. 

[0065] Deactivate: NC=>SAM 



[0066] At the end of the acceptable auto avoidance zone, the 

SAM will be notified to 'sleep' until needed again by issu- 
ing a 'Deactivate' message. 

[0067] Periodic 

[0068] Periodic messages transmit at a fixed rate from source to 
destination. If destination fails to receive periodic trans- 
missions after to be determined periods, a communica- 
tions fault condition is flagged. 

[0069] Deviation Update: SAM => NC 

[0070] From the 'Start Deviation' event through the 'End devia- 
tion' event, these are transmitted periodically from the 
SAM to the NC. 

[0071 ] Orientation update: NC => SAM 

[0072] Provides scanner position and location in plant frame to 
the Sinas algorithms. Updates begin following the 'Acti- 
vate' event message and are transmitted periodically 
thereafter until the deactivate event. 

[0073] ^ more complex scenario 

[0074] In this case, illustrated in Fig. 5, an initial obstruction is 
avoided, but then an extension is detected which can be 
maneuvered around. A second detect and start deviation 
message set is exchanged, allowing a maneuver around 



the extended obstruction. Clear is indicated only after full 
return to the main path can be achieved in a single ma- 
neuver. 

[0075] Changes and modifications in the specifically described 
embodiments can be carried out without departing from 
the principles of the invention which is intended to be 
limited only by the scope of the appended claims, as in- 
terpreted according to the principles of patent law includ- 
ing the doctrine of equivalents. 



